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ABSTRACT 


Six  test  pilots,  using  a  specially  instrumented  F-IOOD,  flew  nine  dives  each 
at  a  ground  target.  The  task  was  to  align  the  aircraft  with  the  target  as 
quickly  as  possible.  Initial  altitude  (7,000,  8,000,  or  9,000  feet),  dive 
angle  (10%  20°  or  30°),  slant  range  at  alignment  (6,035  to  50,869  feet), 
and  individual  pilot  differences  did  not  affect  accuracy  of  alignment. 
Turbulence,  as  judged  by  the  pilots,  decreased  both  accuracy  and  task  time. 
Mean  task  performance  time  was  approximately  nine  seconds  and  mean  accuracy 
was  approximately  five  minutes  visiial  angle. 
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SECTION  I 


INTRODUCTION 


There  has  been  a  number  of  occasions  when  knowledge  of  the  precision  with 
which  a  pilot  can  position  an  aircraft  in  reference  to  a  target  would  have 
been  useful  information.  Some  of  the  most  recent  uses  for  which  this  type 
of  information  would  be  particularly  applicable  are  for  the  advanced 
guidance  systems  which  have  been  proposed  for  tactical  missiles.  Since 
the  missile  guidance  error  is  usually  known,  the  following  study  was  con¬ 
ducted  to  determine  how  much  error  was  ascribable  to  the  man-machine 
interface,  and  thus  allow  the  calculation  of  total  system  error. 

Since  it  was  uneconomical  to  experimentally  test  all  of  the  many  variables 
associated  with  the  problem,  the  more  important  of  these  were  chosen.  Thus 
this  study  contains  measures  of  the  effects  of  inter-  and  intra-pilot  varia¬ 
tion,  altitude,  dive  angle,  slant  range,  task  perfomnance  time  and  turbulence. 
Training  was  not  of  major  interest  here,  and  the  subjects  utilized  were 
highly  trained  test  pilots.  One  of  the  more  important  variables  which 
received  no  treatment  was  that  of  target  visibility.  Decreased  target  visi¬ 
bility  would  be  expected  to  affect  performance  of  the  experimental  task  »sed, 
but  investigating  that  parameter  lay  beyond  the  scope  of  this  study. 


SECTION  II 
METHOD 


Design 

This  study  /ias  conducted  as  a  6  x  3  x  3  factorial  design  in  which  the  subjects, 
dive  angles  and  ini.tial  altitudes  were  the  respective  variables.  Fuel  manage¬ 
ment  considerations  caused  deviations  from  a  counterbalancing  procedure  for 
the  succession  of  treatments.  Therefore,  the  altitudes  were  flown  in  an 
ascending  or  descending  series  of  2.134,  2,439  and  2.743  km  (7,000,  8,000  and 
9,000  feet).  Similarly,  the  dive  angles  were  flown  in  a  repetitive  10°,  20° 
and  30°  series.  When  a  position  fix  was  missed  or  the  recording  film  was 
poor,  the  missed  trial  was  made  up  at  the  end  of  the  day's  runs  or  on  a  sub¬ 
sequent  flight.  This  tended  to  make  the  succession  of  the  treatments  somewhat 
haphazard. 

Subjects 

The  subjects  were  six  flight  test  pilots  on  assignment  to  the  Air  Force  Flight 
Test  Center,  Each  had  greater  than  1,000  hours  in  high  performance  jet  air¬ 
craft  of  type  flown. 

Equipment 

The  test  aircraft  was  a  F-IOOD  equipped  with  an  A-4  gunsight  which  was  colli¬ 
mated  with  a  gun  camera.  The  camera  was  operated  by  the  second  detent  of  the 
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mihJ:  Accelerometers  which  were  to  record  turbulence  levels  during 
the  flights  were  also  mounted  in  the  aircraft,  but  failed  to  give  usablS^data. 

Procedure 


conducted  at  Edk-ards  Air  Force  Base,  California.  The 
subjects  were  instructed  in  the  flight  profiles  and  briefed  on  the  general 

'«re  given  ^StioS^ 

radar  tracking  station  which  placed  them  in  the  appropriate 

^  "  5°f  “  consisted  of  fLe  Junk 

a.  '  on«^n  ^  ®  pattern  so  that  one  car  was  in  each  of  four  corners 

Jhead  th^  a  squ^  with  a  25  foot  diagonal.  When  given  the  go- 

pilot  was  to  enter  into  one  of  the  various  zero  bank  angle  dives, 

ffiiflvht*  ^**°**^*r*  target  appeared  under  the  crosshairs  of  the 

a^eeze  the  gun  switch  through  the  second  detent,  and  pull  out  of 
squeezed,  the  pilot  was  to  notify  the  radar 

wllSPf  S  f  of  •''is  position 

gS  i  *®i‘  ®'”**  °f  alignnent  taken  from  the 

ss  the  measures  of  performance.  The  pilots  were  then 
to  mark  their  Mssion  cards  with  Judgments  (heavy,  medium,  light,  or  none)  of 

fPr  Hi  ?J?®®  experienced  during  the  dive  and  then  fly  around 

f»L!J  subjects  were  instructed  that  accuracy  was  the  most 

important  part  of  the  task  but  that  speed  was  also  desired,  ^e  nature  of 
®*u^  °  ®"oourage  rapid  perfonnance  of  aircraft  alignment  to 
W”"*  ^*'®  8>^und,  but  it  is  doubted  that  this  had  a  deleterious 

to  ^®®*!  the  aircraft  flying  speeds  as  close 

to  mach  0.95  as  the  pilots  could  maintain. 


SECTION  III 

RESULTS  AND  DISCUSSION 


^  altitudes,  but  there  were  some  devia- 

planned  dive  angles.  Of  the  54  dives  made,  40  of  them  were 
‘^®f*’®®  52  were  made  within  three  degrees  of  the  designated 

°  consisted  of  +4  and  -5  degree  deviatiens.  For 

d^n!t-H^Hr®^®^i®  all  perfonnance  measures  were  grouped  according  to  the 

f^^®+  /®^f°™“®«  measured  in  .5  mil  increments  as  devia- 
SiPPL  ^®y  “•®  reported  here  in 

SPki  ?®i  ‘*®  comparable  to  other  reported  visual 

inti  th«^H?i  I  describes  the  frequency  distribution  of  scores  broken  down 
eSiPr^ihlS  ?hi^H?“  °f/®^ation.  In  elevation,  4W  of  the  trials  had  zero 

^rJv^ihLiP  nP  ®'^'^  ‘^^«®®o  undershoots 

Md  overshoots  on  the  remaining  59^  of  the  trials,  representing  an  average 

error  of  2.19  ^utes  visual  angle.  In  azimuth,  however,  onl^  18.5Jf  of^he 

®®~  ®"°^*  '*^^®  resulted  in  left^ror  and  only 

U.8»  in  right  error,  representing  a  mean  of  4.15  minutes  visual  angular 
error.  The  distribution  of  azimuthal  scores  indicates  two  things:  (a)  there 
azimuthal  aiming,  and  (b),  there  is  a  bias  towards  the 

al  thev  '^*®®°!:®®-  '^®“®  ““®^  ‘’®  considered  separately 

as  they  undoubtedly  stem  from  different  sources.  ^ 
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It  is  not  easy  to  account  for  the  bias  present  in  the  scores  since  an  adequate 
account  should  require  that  the  airplane  be  checked.  The  equipments  utilized 
were  removed  from  the  aircraft  and  the  aircraft  was  assigned  to  another  flight 
test  before  the  bias  was  discovered  and  so  a  checkout  was  not  performed.  In 
discussions  with  F-lOO  pilots  about  the  bias  in  the  scores,  all  factors  but 
misalignment  of  the  camera  with  the  gunsight  were  discounted  in  the  absence 
of  ^ther  information  about  the  particular  aircraft  used.  On  the  possibility 
that  the  error  pattern  was  due  to  faulty  collimation  of  the  camera  and  gun- 
sight  the  data  are  analyzed  both  with  and  without  a  one  mil  right  azimuth 
correction.  This  correction  was  chosen  to  render  the  mean  of  the  distribution 
of  the  errors  equal  to  zero.  The  corrected  distribution  represents  an  average 
error  of  3.53  minutes  visual  angle, 

^e  greater  variance  in  error  scores  in  the  azimuth  direction  as  compared  with 
the  elevation  direction  is  due  to  the  aerodynamic  control  of  the  aircraft 
which  makes  course  corrections  more  difficult  to  achieve  than  pitch  correc- 
tions.  ^ 


TABLE  I 


FREQUENCY  DISTRIBUTION 

OF  ERRC-l  DIRECTION 

m  PILOTS^ 

Pilot 

Azimuth 

Elevation 

No. 

Zero 

Left 

Pdght 

Zero 

Over 

Under 

1 

5(6) 

3(3) 

1(0) 

4 

2 

3 

2 

1(4) 

6(3) 

2(2) 

6 

1 

2 

3 

1(4) 

6(3) 

2(2) 

1 

5 

3 

4 

2(4) 

6(5) 

1(0) 

5 

2 

2 

5 

1(3) 

8(2) 

0(4) 

3 

2 

L 

6 

0(5) 

7(2) 

2(2) 

3 

5 

*T 

1 

^Numbers 

in  parentheses  are  for  the  distribution  of 

corrected  scores. 

T^e  basic  data  may  be  found  in  the  appendix.  Table  II  lists  the  means  and 
st^d^d  deviations  &r  each  subject  computed  from  the  error  data.  The  cor¬ 
relation  between  the  means  and  standard  deviations  of  the  basic  data 

^  -8286,  p<.05)  dictates  that  a  variance  stabilizing  transformation  be 
placed  on  the  data  before  a  variance  analysis  is  performed.  The  transforma¬ 
tion  used  was  the  modified  square  root  transform  (  /x  t  /x  -  l)  suggested 
by  Freeman  and  Tukeyi. 


^Freeman,  M.  F.  and  Tukey,  J.  W.  Transformations  related  to  the  angular  and 
the  square  root.  Ann.  Math.  Statist.,  1950,  21,  607-611.  - 
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TABLE  II 


MEANS  AND  STANDARD  DEVIATIONS  OF  PILOT  PERFORMANCE 
(ENTRIES  AliE  IN  MINUTES  OF  ANGULAR  ERROR) 


Pilots 

1 

2 

3 

4 

5 

6 

Means 

4.22 

5.38 

7.18 

7.28 

4.46 

5.05 

Standard  Dev 

^  2.59 

3.83 

4.09 

4.98 

3.02 

1.V2 

The  results 

of  the  analysis 

of  variance 

are  shown 

in  table 

III.  From 

the 

summary  it  is  obvious  that  neither  of  the  testable  main  effects  (altitude  and 
dive  angle)  and  none  of  the  second  order  interactions  are  significant. 


TABLE  III 

ANALYSIS  OF  VARIANCE  ON  TRANSFORMED  SCORES 


Source 

df 

ss 

ms 

Altitude  (A) 

2 

1.49 

.75 

Dive  Angle  (D) 

2 

.72 

.36 

Subjects  (S) 

5 

11.35 

2.27 

AXD 

4 

5.16 

1.29 

AXS 

10 

36.61 

3.66 

DXS 

10 

14.91 

1.49 

AXDXS 

20 

64.58 

3.23 

TOTAI^  53  134-82 


Since  there  is  no  appropriate  error  term  for  testing  the  subjects  main  effect, 
the  range  determined  allowances  method  of  Link  and  Wallace  described  by 
Hosteller  and  Bush^  was  applied.  The  results  of  this  analysis  can  be  found 
in  table  IV  from  which  it  can  be  seen  that  no  significant  pilot  differences 

exist. 


^Hosteller,  F.  and  Bush,  R.  R.  ’’Selected  Quantitative  Techniques  in  Handbook 
of  Social  Psychology.”  Gardner  Lindzey  (Ed.).  Cambridge:  Addison  -  Wesley, 


1954. 
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RANGE  DETERMINED  ALLOWANCES  FDR  PILOT  DIFFERQvCES 
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Sum  of  ranges  84.78 
Critical  Factor  .62 
52.56 


The  analysis  of  variance  for  the  corrected  and  similarly  transfomed  scores 
is  suinniarized  in  table  IV  from  which  it  can  be  seen  that  the  same  conclusions 
are  warranted  from  it  as  were  drawn  from  the  previous  analysis  on  the  uncor¬ 
rected  scores. 


TABLE  V 

ANALYSIS  OF  VARIANCE  FOR  CORRECTED  SCORES 


Source 

df 

ss 

ms 

Altitude  (a) 

2 

5.64 

2.82 

Dive  Angle  (D) 

2 

.58 

.29 

Subjects  (S) 

5 

17.71 

3.5; 

AXD 

4 

6.07 

1.52 

AXS 

10 

13.46 

1.34 

DXS 

10 

21.74 

2.17 

AXDXS 

20 

52.98 

2.65 

TOTALS  53  118.18 


Although  for  a  given  altitude  and  dive  angle  combination  each  pilot  started  the 
dive  at  approximately  the  same  slant  range  to  the  target,  the  task  time  varied 
which  in  turn  varied  the  slant  range  sighting.  This  could  have  obviated  a 
significant  Altitude  X  Dive  Angle  interaction,  so  a  Speaman  rho  was  computed 
for  sighting  error  and  slant  range  at  sighting.  The  corroslation  coefficient 
yielded  was  virtually  zero  (p  --  .015,  di  ^  53)* 

Since  none  of  the  independent  variables  or  their  interactions  are  significant, 
one  can  characterize  the  performance  of  the  task  with  simple  descriptive 
statistics.  The  mean  error  for  all  subjects  under  all  conditions  was  5.39 
minutes  of  angular  error;  the  standard  deviation  is  3.75  minutes  of  angular 
error.  For  the  corrected  scores  the  mean  and  standard  deviation  were  4.82 
and  3.39,  respectively.  Task  performance  time  (from  pushover  to  gun  camera 
activation)  ranged  from  1.6  to  31*2  seconds  with  a  mean  of  8.76  seconds  and 
a  standard  deviation  of  1.84  seconds.  All  subjects  were  able  to  perform  the 
task  at  least  once  with  less  than  4^  arc  error  in  less  than  8.76  seconds  with 
four  of  the  subjects  completing  the  task  this  quickly  with  less  than  2*  arc 
error. 

Although  the  accelerometers  did  not  yield  usable  data  for  measuring  the  effects 
of  turbulence  on  performance,  pilot  judgments  were  recorded  after  each  trial. 
Four  of  the  pilots  used  all  of  the  four  rating  categories  for  turbulence: 
none,  light,  medium  and  heavy.  Two  pilots  did  not  judge  any  of  the  trials  as 
being  conducted  under  heavy  turbulence.  Table  VI  describes  performance  under 
the  variously  judged  trials. 


6 


TiVBLE  VI 


PERFDRMANCE  UNDER  JUDGED  TURBULENCE 


JUDGED  TURBULENCE 


None 

Light 

Medium 

Heavy 

No.  of  trials 

10 

24 

14 

6 

Range  of  error 
scores 

1 

O 

q 

o 

1.72  -  8.59 

3.95  -  8.76 

6.86  • 

Mean  error  score 

1.62 

4.68 

6.72 

13.24 

Mean  task  time 

10.77 

8.97 

7.69 

7.17 

An  extension  of  the  median  test  yielded  ax^  22.08,  3  df,  p  <.001  between 
the  judged  conditions.  Although  the  judged  turbulence  could  have  been  used 
as  a  medium  to  alibi  poor  performance,  disci  ssions  with  two  of  the  pilots 
vdio  served  as  subjects  caused  the  author  to  conclude  that  this  was  not  the 
case. 

Table  VI  also  demonstrates  the  inverse  relationship  which  obtained  between 
judged  turbulence  and  task  time.  The  difference  between  the  turbulence  condi¬ 
tions  is  significant  (X^  8.27,  3  df,  p<.05)-  Since  this  relationship 

indicates  that  the  greater  the  turbulence,  the  less  time  a  pilot  was  willing 
to  stay  in  the  dive,  the  poorer  accuracy  found  in  turbulence  could  be  due  to 
the  combined  factors  of  mechanical  task  interference  and  the  induction  of 
reduced  task  time. 


SECTION  IV 
CONCLUSION 


in  a  high  performance  aircraft  a  pilot  can  perform  an  aircraft  aiming  task  with 
a  fairly  high  degree  of  accuracy.  During  these  tests  the  task  was  performed 
in  approximately  9  seconds  with  an  accuracy  of  approximately  5’  visual  angle. 
This  reflected  an  average  of  4..15^  (3*53’  corrected)  azimuthal  error  and  2.19’ 
elevation  error.  Initial  altitude,  slant  range  and  dive  aiigle  gave  no  evidence 
of  affecting  accuracy.  There  was  no  evidence  of  significant  inter-subject 
differences.  Turbulence  did  affect  accuracy,  though,  with  performance  approach¬ 
ing  laboratory  levels  of  visual  acuity  in  the  absence  of  judged  turbulence. 
Turbulence  also  affected  task  time  with  the  higher  levels  of  turbulence  result¬ 
ing  in  decreased  task  times.  Since  greater  pilot-aircraft  error  occurs  in  the 
azimuthal  direction,  greater  efforts  directed  at  reducing  missile  guidance 
error  in  this  direction  are  warranted. 
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Change  the  equation  In  the  third  paragraph,  6th  line  to  read; 


(  ^/lc  +  v^x  +  1  ) 
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On  the  bottom  line  of  Table  IV  the  figure  "52.56"  should  be  preceeded  by  the 
word  "  Allowance . " 
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